Long Range Frustrations in a Spin Glass Model of the Vertex Cover Problem* 
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In a spin glass system on a random graph, some vertices have their spins changing among different 
configurations of a ground-state domain. Long range frustrations may exist among these unfrozen 
vertices in the sense that certain combinations of spin values for these vertices may never appear 
in any configuration of this domain. We present a mean field theory to tackle such long range frus- 
trations and apply it to the NP-hard minimum vertex cover (hard-core gas condensation) problem. 
Our analytical results on the ground-state energy density and on the fraction of frozen vertices are 
in good agreement with known numerical and mathematical results. 
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The energy landscape of a large spin glass system is 
very complex. There may exist (exponentially) many 
ground-state and metastable domains in the configura- 
tional space; these domains are mutually separated from 
each other by (infinitely) high energy barriers. At low 
temperature, the system may get trapped in one of these 
configurational domains, and ergodicity is broken. In the 
cavity field formalism []| of mean field theory of finite 
connectivity spin glasses |^ H, Q, microscopic configu- 
rations of a system are therefore grouped into different 
macroscopic states (hereafter, a macroscopic state is sim- 
ply referred to as a 'state' and a microscopic configuration 
as a 'configuration'). In a given state each vertex i feels 
a cavity field hi that may be different for different ver- 
tices, and the fiuctuation of this field among all the states 
is characterized by a probability distribution Pi{hi) that 
again may be different for different vertices. 

The ground-state energy landscape of a spin glass sys- 
tem can be studied by the zero temperature limit of the 
cavity field theory In this limit and in a given state a, 
the spin value Ui of a vertex i either is positively frozen 
(cT; = +1 in all configurations) or is negatively frozen 
{oi = —1) or is unfrozen (ui fiuctuates over ±1 among 
configurations of state a). A crucial assumption of the 
cavity field theory 0, 0| is that, with probability unity 
each of the 2" combinations of spin values for n ran- 
domly chosen unfrozen vertices is realized in configura- 
tions of state a. However, this conventional cavity field 
theory leads to negative values of structural entropy S j3| 
when loops of spin-spin interactions become abundant 
(see, e.g., or even causes certain type of 

divergence in the population dynamics 0, llH . To over- 
come these difficulties, a positive re- weighting parameter 
y can be introduced and its value be determined self- 
consistently by requiring S(y) = 0. This procedure 
is however not quite satisfactory; in case of the vertex 
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cover problem, it predicts a ground-state energy that is 
systematically lower than the actual value 0- 

Here we discuss the possibility of long range correla- 
tions among spins of different unfrozen vertices. Both 
the spins of two unfrozen vertices i and j will certainly 
fluctuate among configurations of a state a. On the other 
hand, we find that with certain probability (Ji and aj may 
be prohibited to take certain combination of values (e.g. 
Ci = fJj = —1) in all configurations of state a, even if 
i and j are far apart from each other in terms of short- 
est path length. To detect such long range frustrations 
among unfrozen vertices, our idea is to flip the spin of 
one unfrozen vertex and then check whether this pertur- 
bation propagates to other unfrozen ones. This Letter 
reports our calculations on a spin glass model ^ of the 
NP-hard minimum vertex cover problem 12^ .13,. ,14. ,15} , 
which is equivalent to the hard-core gas condensation of 
physics |l6|. A long range frustration order parameter 
R is defined. In this model the quenched randomness 
comes from the underlying random graph. Work on sys- 
tems with additional quenched randomness of spin-spin 
interactions is reported in an accompanying paper 11]. 

For the vertex cover model, we show that long range 
frustration builds up (i? > 0) when the mean vertex de- 
gree c of the graph exceeds c = e = 2.7183. Analyti- 
cal predictions on the ground-state energy density and 
on the fraction of frozen vertices are both in very good 
agreement with known numerical and mathematical re- 
sults. The calculations are carried out through the cavity 
approach. It remains open whether the same results are 
achievable by the replica method. Our approach is es- 
sentially replica symmetric in the sense that (a) we focus 
attention on just one of all possible macroscopic states, 
(b) the statistical property of this state is specified by just 
three mean field parameters to be defined, R, q+ and qq. 
Competitions among multiple states will be included in 
the theory in future work. 

We first introduce the random graph vertex cover prob- 
lem. A random graph G{N, c) has N vertices; and be- 
tween any two vertices an edge is present with probability 
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c/{N — 1). The average number of edges incident to a 
vertex is c (the mean vertex degree). For large graph size 
N , a vertex's probability of having k edges is given by 
the Poisson distribution PrXk) = e~'^c^ /k\. Denote E{G) 
as the edge set of graph G. A vertex cover of G consists 
of a set of vertices A = {ii, i2, • ' ' : *m} such that if edge 
(j, j) e E{G), then either i G A or j G A or both. The 
vertex cover problem consists of finding a vertex cover A 
with size |A| < tiq, tiq being a prescribed integer. This 
problem is mapped to a spin glass model with energy 
functional 

Ui = —1 if vertex i G A (covered) and Ui = +1 otherwise. 

The ground-state configurations of model |^ corre- 
spond to vertex cover patterns with the global minimum 
size . These configurations may be grouped into differ- 
ent states Two configurations in the same state are 
mutually reachable by hipping a finite number of spins in 
one configuration and then letting the system relax. (Ac- 
cording to this definition of states, two configurations of 
the same state can have a Hamming distance scaling lin- 
early with system size N .) Let us focus on one state, 
say a. In state a, the spin value of a randomly cho- 
sen vertex i may be fixed to cr^ = -1-1, or to (Ti = — 1, 
or fluctuate over ±1. The fraction of positively frozen, 
negatively frozen, and unfrozen vertices in state a is 
q_, and go respectively. (By the way, we notice that 
in the minimum vertex cover problem, the parameters 
{q+, <?-, 9o) a-re the same for different ground-state states, 
due to the fact that the energy density is determined by 
Eq. ©.) The probability that among k vertices that 
are randomly picked up from G{N, c) kg are unfrozen, 
fc+ positively frozen, and fc_ (— k ~ ko — k^) negatively 

frozen is fc!/(fco!fc+!fc-!)(Jo°'?+^9_" (in the large N limit). 

Since the spin of an unfrozen vertex i fluctuates among 
different configurations of state a, the 'correlation length' 
of this fluctuation is an important issue. We ask the 
following question: If Ui is externally fixed to at = — 1, 
how many other unfrozen vertices must eventually fix 
their spins as a consequence? 

For a random graph of size N ^ oo, the total number 
s of affected vertices may scale linearly with N. If this 
happens, vertex i is referred to as type-I unfrozen. The 
probability for this to happen is denoted as R (which de- 
fines our long range frustration order parameter). The 
total number of affected vertices may also be finite. In 
this case, vertex i is type-II unfrozen. Based on insights 
gained from studies on random graphs |l7l | , we know that 
the percolation clusters evoked by two type-I unfrozen 
vertices have a nonzero intersection (of size proportional 
to N). Therefore, the spin values of all the type-I un- 
frozen vertices must be strongly correlated. If we ran- 
domly choose two type-I unfrozen vertices i and j, then 
with probability one-half their spin values can not be 



negative simultaneously: if = —1, then aj must be 
+1; if (Tj = —1, then ai must be -|-1. On the other 
hand, two randomly chosen type-II unfrozen vertices are 
mutually independent, since each vertex can only influ- 
ence the spin values of s ~ 0{1) other unfrozen vertices 
while the shortest path length between two randomly 
chosen vertices of G(N, c) scales as InA^ and becomes 
divergent when — > oo [llf. Denote /(s) as the prob- 
ability that a randomly chosen unfrozen vertex i, when 
flipped to ai — —1, will eventually fix the spin values 
of s unfrozen vertices with s being finite and therefore 
limAT^oo s/N = 0. 

We calculate the parameters qq, q- by the cav- 
ity field method 0, 0| : First a random graph G{N, c) 
is generated; then a new vertex i is connected to a set 
Vi oi k randomly chosen vertices in G{N,c), k following 
the distribution Pc{k); the unfrozen/frozen probabilities 
{qa{i), q+{i), q- («)} of vertex i in the enlarged graph (de- 
noted as G') is then calculated. We assume the following 
convergence condition: \vaiN^oo{qQ{i),q+{i),q-(i)} = 
{go I 9+7 9- }■ This enables us to write down a set of self- 
consistent equations in the large N limit. 

If the new vertex i is positively frozen, then none of the 
vertices in Vt are positively frozen in graph G. Further- 
more, there are two possible situations: (i) no vertices 
in Vi is type-I unfrozen in G; or (ii) some of the vertices 
in Vi are type-I unfrozen. In case (ii), all these type-I 
unfrozen vertices will take spin value —1 simultaneously 
in some configurations of state a, so that vertex i will 
have ai = +1 as it is added into the system. With this 
analysis, we get a self-consistent equation for g+: 

oo k 

q+ = 5]P,(A:)^CiM)'('Zo(l-i?)+9-)'"'2i^' 

OQ 

+ ^P,(A;)(go(l-i?) + g-)' 

fc=0 

= 2e~'^''+~^^^'^^'^''°^' — e^'^''+^'^'"'^' (2) 

where C[ = kl/{l\{k - Z)!)- Equations ©, ©, (gl and 
are derived elsewhere 

If the new vertex i is unfrozen, there are also two possi- 
bilities concerning the spin values of vertices in Vi'. (iii) 
none of them is positively frozen in G; or (iv) one of 
them is positively frozen in G. To ensure vertex i will be 
unfrozen, in situation (iii) two or more of the vertices in 
Vi must be type-I unfrozen in G, among which one is in 
confiict with all the others; and in situation (iv) some of 
the vertices in Vi may be type-I unfrozen in G, but they 
must be capable of taking spin value — 1 simultaneously. 
Therefore, we get a self-consistent equation for qo fl^ : 

qo = (2cg+ + cgoi?)e"'=«+-(^/2)cqoi?^ 

^{cq+ + cqoR + (cgoi?)V4)e~^'+-^*'' • (3) 

If the spin of an unfrozen vertex i is flipped to cr^ = —1, 
it may not affect any other vertices (s = 0), provided 
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its local environment is described by the above men- 
tioned situation (iii). This happens with probability 
Pi = 1 — cq^/q^. With probability 1 — pi, the unfrozen 
vertex i encounters a local environment of type (iv) , that 
is, one of its nearest neighbors vertex j is positively frozen 
in graph G. This vertex j must face the local environ- 
ment of type (i) in graph G if vertex i is type-II unfrozen. 
(If vertex j has the local environment of type (ii), flip- 
ping the spin value of vertex i to (7^ = —1 would cause 
a percolation cluster of size proportional to N .) With 
these preparations, we obtain the following self-consistent 
equation for the distribution f(s) jl^ : 

I 

f{s) = p,5i + (1 - ^ F,, (/) ^ n /('^™)et-+^' • 

(4) 

In Eq. Q), 5 is the Kronecker symbol; and c' = cqo{l — R) 
is the mean number of type-II unfrozen vertices adjacent 
to a positively frozen vertex. Since R = 1— X^^o /('^)' 
establish that the long range frustration order parameter 
R is determined by the following equation: 

i?=K/9o)(l-e-^^°^(i-^0 . (5) 

A positive R signifies the appearance of a percolation 
cluster of unfrozen vertices whose spin values are strongly 
correlated. 

Figure shows the value of i? as a function of mean 
vertex de gree c. i? = when c < e; this is consistent 
with Ref. 19] that, a minimal vertex cover pattern can 
be found by a polynomial leaf-removal algorithm. When 
c > e, a finite fraction of the unfrozen vertices are long- 
rangely frustrated ; th e leaf-removal algorithm outputs a 
looped subgraph [l^- At mean vertex degree c ~ 40, 
the order parameter R reaches a maximal value; then it 
gradually decays as c is further increased. 

The fraction of vertices that are covered in a minimal 
vertex cover is IS] 

= 1-0^ -an/2 . f6) 

\ \ I \ \ \ \ \ \ 
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FIG. 1: The long range frustration order parameter R. 



Figure 121 shows the relationship between X,„in and mean 
vertex degree c. At large c values, Eq. ((BJ is in agreement 
with a rigorous asymptotic expression given by Frieze 
|20|: at low values of c, it is in agreement with the exact 
enumeration results of Weigt and Hartmann . These 
excellent agreements are quite encouraging in view of 
the fact that all previous efforts failed [i 111 Q. It 
has already been established that when c > e the replica 
symmetric solution of vertex cover problem becomes un- 
stable ll^l Il3 | ; but earlier replica symmetry breaking so- 
lutions either resulted in negative structural entropy or 
predicted a minimal vertex cover size noticeably lower 
than the actual value 

So far we have focused on only one ground-state state 
of the vertex cover problem. When c > e it is believed 
that there are many such states (replica symmetry break- 
ing). This is consistent with our observation that, when 
c > e the fraction of frozen vertices (= 9+ + g-, dashed 
lines in Fig.^J in one state is much higher than the actual 
fraction of frozen vertices estimated numerically (symbols 
m Fig. 13 Hi- This is easy to understand: A frozen ver- 
tex in one state may be unfrozen or be frozen to the op- 
posite spin value in another state. At the moment we are 
unable to construct a theory to include the competitions 
among different states. As a first attempt, we make the 
following conjectures: (a) if a vertex is positively frozen 
in one state, it is positively frozen in all states; and (b) a 
vertex is negatively frozen in all states only if it is adja- 
cent to two or more positively frozen vertices. Then an 
expression on the fraction of frozen vertices is obtained 
0: 

V = q+ + \- e-'"i+ - cg+e-^«+ . (7) 

The agreement of Eq. (0 with the numerical data of 
Ref. 14] is quite good (Fig. This is an issue to be 
understand more deeply. 
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FIG. 2: The minimal vertex cover fraction Xmin (Eq. 0, 
solid line) and its comparison with the asymptotic formula of 
Ref. I20II (dashed line) and the numerical results of Refs. |l^ 
(symbols). 
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FIG. 3: Fraction of frozen vertices in all macroscopic states 
(Eq. 10, solid lines) and its comparison with the numerical 
results of Ref. [T^ (symbols) and the fraction of frozen vertices 
in one macroscopic state (dashed lines). 

To summarize, we have studied long range frustrations 
among unfrozen vertices in a macroscopic state of a spin 
glass system. We found that, with certain probability, 
the fluctuations of the spin values of two or more dis- 
tantly separated unfrozen vertices are highly correlated. 
A long range frustration order parameter R was calcu- 
lated to quantify this strong correlation. When apply- 
ing our method to the NP-hard minimum vertex cover 
(hard-core gas condensation) problem, the analytical 
predictions concerning the ground-state energy density 
and the fraction of frozen vertices are in good agreement 
with known numerical and rigorous results. The basic 
idea behind this paper is also applicable to other spin 
glass systems jllj . 

We emphasize that the appearance of many macro- 
scopic states in the energy landscape of a spin glass sys- 
tem does not necessarily mean the existence of long range 
frustrations among unfrozen vertices in a single macro- 
scopic state. As an counter-example, in the maximum 
matching problem j2l[ there is no long range frustrations 
(i? = 0) but there exist an exponential number of macro- 
scopic states. It is interesting to notice that the max- 
imum matching problem can be solved by polynomial 
algorithms. It appears that, the proliferation of macro- 
scopic states is not the real reason of the computational 
complexity in finding a ground-state configuration for a 
disordered system. As another example, there are many 
macroscopic states in a typical random 3-satisfiability 
formula when 3.921 < a < 4.267 (here a is the clauses- 
to- variables ratio); but the survey propagation algorithm 
is able to find a solution efficiently 0, Q . 

On the other hand, we believe the existence of long 
range frustrations among unfrozen vertices will make 
it intrinsically difficult for a search algorithm to find a 
ground-state configuration. Because of these long range 



effects, it is difficult (a) to determine whether a vertex 
is frozen or unfrozen in a macroscopic state and, (b) to 
trace the percolation cluster associated with a given un- 
frozen vertex. Recently, some NP-hard combinatorial op- 
timization problem in computer science were studied by 
zero temperature cavity field method 

0,0,1113 We 

hope the present work, besides improving our under- 
standing of finite connectivity spin glasses, will stimulate 
further efforts in finding more efficient algorithms. We 
are presently implementing the physical picture of this 
paper into an algorithm for the vertex cover problem. 
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